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TEACHERS OF ENGLISH IN HIGH SCHOOL CAN BE ALERTED AND TRAINED 
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THAT THOSE EXPOSED TO THE EXPERIMENTAL PROGRAM HAD BECOME 
MORE AWARE AND APPRECIATIVE OF THE VALUE OF TEACHING FOR 
CRITICAL THINKING THAN HAD STUDENTS IN THE CONTROL GROUP. 
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APPENDKES 



I. IHTRODUOTION 



A, Problora, Background, and Revievy of Related Research 

The late President Kennedy in his February 20, 1951 message to 
Congress on education reminded Americans that the human mind is a 
fundamental resource, that progress as a nation can be no swifter 
than progress in education, and that America must be concerned with 
the development of every young American’s capacity# 

The possibilities of developing that capacity have always been 
recognised by educators, Whether one begins with the warnings of 
Socrates about being wise enough not to trust unchecked judgments, 
whether one eisamines formal statements made by educational organizations 
or whether one scrutinisscs the research of individual psychologists 
and educators, one reaches the same conclusion: teaching students to 
think alv/ays ranked and still ranks high as an educational objective# 

In 1952 the Commission on the English Curriculum of the national 
Council of Teachers of English made a forceful statement (7): 

•••democracy at its best demands of its citizens 
ability to think clearly, to attack problems in- 
telligently, and to exercise critical judgments 
•••at every level of instruction they should have 
opportunity to set forth their ideas concerning 
topics of interest to them, to substantiate their 
statements X7ith evidence, to draw inferences carefully, 
and to order their ideas clearly for presentation 
to others# At the same time they should have practice in 
those skills xjhich freedom of speech and of press demand 
of the listener and the reader • They should 
evaluate critically ideas found in newspapers, 
books and magazines, heard in discussion or over 
the radio, or presented on the screen, learning in 
the process to validate authority, to distinguish fact 
from opinion, to recognize untoward emotional appeal, 
and to detect false inference or unsubstantiated 
generalizations • 

In the 1953 rxvlex? of Educational iiesearch , David Russell (22) 
encouraged the study of the problem when he x/rote: 

The study of children’s thinking is a wide-open 
field for research x/orkers in education and child 
development* Many investigations of children’s 
percepts, memories, fantasies, and the x;ay they do 
problem solving, critical thinking, and creative 
thinking are still needed, especially In the group 
or classroom setting# Only then can the aim of 
"teaching pupils how to think" operate in most 
classrooms as x/ell as in those of some gifted teachers 
today. 



The Educational Policies Comission of the KEA in 1951 said 
■'The Central IXirposa of American Education" that the common 
of education is the development of the ability to think. 
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Eussell summarized the findings of psychologists by telling us that 
although the aspects of mental life have only begun to be e::ploroci, 
there is considerable agrenent by psychologists that the processes of 
thinking are probably very fc'jj though the materials of thinking 
are multitudinous. Hundreds or thousands of percepts, memories, a?"' 
conceptions can be used in only four or five different ways: assoc:* ative 

thinking, convergent thinking, and problem solving v;ith its 5.ntor« 
changeable steps of identification, data gathering, hypothesizing, 
and tasting. The latter comes close to the related activity of 
critical thinking-, Ha thought that this was of enormous teportance 
to teachers. Thinking activities must be varied in the typical 
classroom, but this variation exists largely In the materials-- 
in the wide range of ideas or the content of the modern curriculum. 



Raths, Jonas, Roths teiii, and Uasserman in Teachi ng for Thinking (20) 
express similar convictions ^/hen they say that evidence frem many 
sources indicates that thinking as an aim is giveii much lip service 
but very little practical application in the classroom. They 
agree that there is no profound reconstruction of the curriculum 
necessary in order to employ thinking operations. They reviewed 
related research which supports the following conclus:lonc: 



There are ways to stiimtla/te thinking; actual increases 
in thinking test scores can taka place. 



TJhen there is an ciiphasis upon thinking, the bcliacHor 
of children can change during the work of a semester 
without sacrifice in the usual subject matter achievements. 



Interest in the topic has been shown by other investigators among 
whom arc Edward Glaser (11), Paul Bressel (9,10), Kennc n Ilendcrso » 
3. Othaniel Smith (25), iiary Jane Aschner (2,3) and Hilda Taba (2,«*}. 






J.P. Guilford (12) offers an enlightening c;:planation to the problc.i 
of learning and transfer. In his cnalysis of the princit^los in 
regard to the structure of the intellect, he states that there are 
basically five kinds of operations as indicated by five kinds of 
factors, four kinds of content, and six kinds of products, (see A-1, 
page 24) He suggested that this theory may have implications for the 
teaching of critical thinking. It places emphasis on the individual 
as an agent for dealing with information, varieties of information, 
its sources, and the kinds of products that the individual makes of it. 

In the 1950 edition of the Eiic vclopadia of Educational Ilesearc h (21) 

David Russell made the comment that the breadth of the tcpic and the 
variety of recent investigation indicate the growing importance of 
the problem of teaching for thinking. Current interest in the tonic 
is also reflected by the large number of recent publications in the area. 
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Howsvcr j Russoll bcgGii his discussion of criticnl thinlcing h}' stniing 
that the volume of research is not commensurate with the frequency 
of the use of the term in statements of educational objective.^ and 
curriculum materials . 

In a culture where some stress is placed on conformity, critical 
thinking- may be one of the most important abilities tau-'ht in school. 
Children can learn to be critical of what they read or hear and be 
stimulated to various creative t?ndeavors if a competent teacher has 
such definite objectives in mind and works with the «roup toward^ 
these objectives not only in some special levssons but during man/ 
parts of the day’s work. 

Such procedures make more stringent demands upon the teacher than 
simple textbook reading or rote learning in a teacher-dominated 
situation. Such an approach is characterized by a less obvious 
diractive role and a more challenging and more e::acting one in 
encouraging the students to think for themselves. Lmphasis must be 
placed on encouraging the students to do constructive but critteai 

thinking . 

Modern experimental psychologists suggest that all of the transfer^ 
effects of learning are possible by calling attention to simxlarxtie/^ 
and by emphasizing generalizations. The more closely an education c e 
resumble the situations in which the consequences of the education w 11 
be used, the more productive the education will be. Since it is 
impossible, and even undesirable to predict the exact nature of the 
educational needs of students, it seems logical that emphasis should 
be placed upon the development of varied intellectual operations 
rather than on the difficult and now impossible goal of coverage. 

An examination of a number of studies and pertinent literature pointed 
out the desirability of furthering the action research previously carried 
out by this investigator. In 1956 she began seriously to study the 
possibility of conducting research within a classroom setting, 
undertook an experlnental study of the. development of critical thinivlng, 
through the language arts program in the teaching of English la the 
secondary school, a study which she completed in 1962. Her statistical 
fXndln^^s iniicated that a conscious effort to incorporate critical 
thinking in dally instruction can result in observable improvements in 
the development of varied, specific, separable, and measurable skills, 
such as the ability to make decluctie»ns, to make Interprettitions, to 
evaluate arguments, and to recognize xiiferences, assumptions, bias 
factors, cowton fallacies, and prapaganda techniques. The greatest 
gains wero made by the rixperlnental g,rt'up, vis compared with the control 
oroup, In the DRESSEL-MAYIiFdJ TEST with a difference significant at the 
.001 level; next in the COOPETIATIVE READING TEST with a difference sig- 
nificant at the .05 level; and finally in the WATSON-GLASER CRITICAL 
TIlINfUNG APPRAISAL where the difference favored, though not at a 
significant level, the experimental group# Favorable comments were 
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OKprcssecl by means of student and teacher questionnaires regarding 
the G 2 CP crimen tal instructional method which was devised through a 
pilot study in 1959 and through two summer worhsh ps with teachers 
and utilised with the ezperimenta.! g-O'iP it' 1960-61 • The most 
urgent implication of the study v/as the fact that teachers need to 
be alerted atid trained to teach for critical thinking* Through 
ample practice sequentially developed, teachers can provide continuity 
in improving the intellectual operations of their students. 



Zm Objectives and hypothesis 

The investigator’s position in the Education Department of Loyola 
University made it possible and practical to attempt to put into 
action the most urgent implication of his previous study about 
alerting and training teachers for critical thinking. 
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The hypothesis upon which this study v?as based and which guided the 
research v/as this; persons aspiring to become teachers of English in 
high school can be alerted and trained in some of the varied, specific, 
separable, and measurable skills v’hich are needed for critical 
thinking and which are relevant to a high school English program; 
this training should have an effect upon the teachers* abilities 
to think critically. 



The work v/ith the euperimental group was based on the conviction that 
democracy demands of its citizens ability to think clearly, to attct! 
problems intelligently, and to exercise critical judgments. It 
was hoped that having increased their competence in these skills cu," 
having been alerted to the possibility of using critical thinking 
as an integrating principle of instruction, these future teachers 
would be in a positicn to develop in their students some of the 
varied but identifiable skills of critical thinking needed for 
effective life in n democracy. Efforts V7c.rc made to help these 
teachers incorporate critical thinking into the regular content of 
the high school curriculum since these skills arc much better learned 
in the pursuit of meaningful problems than in emphasis upon 
abstract exercises. 



II, IIETIiOD 

A, Administrative Procedures Uithin the University 



Prior to this study, Loyola University offered a course, 1113; 
Techniques of Teaching in Secondary Schools, conceracd with general 
methods of teaching rather than with the methods of teaching a 
, particular subject. The Education Department realized that such a 

^ course was inadequate for English majors and was willing to allotr 

> the experimental procedures described here. This included the 

* formation of a separate section of 1113 during both semesters of 

1955-65 • The students i7ho enrolled in this courac during the first 
semester constituted the control group; the students of the second 
semester constituted the experimental group. The experimental 
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design of this study was approved by Dr. Samuel T. 1-layo, Director 
of Educational Research center of Loyola University, and currently 
the director of the Measurement and Competency Project of tVie U.S. 
Office of Education at Loyola. The test data were analysed by him. 

B. Remote Preparation 



An important preliminary action was planning a syllabus for this 
course. The investigator had previously never taught the course. 

In order to prepare herself for doing this work, she visited a 
number of institutions in Illinois, l*Jisconsin and lotra. She also 
attended a number of local and national meetings and conventions to 
enlarge her perspecbive for the task of training secondary school^ 
English teachers. She studied publications of the National Council 
of Teachers of English, the recent Freedom and Discipli ne In Engli#!,. 

A report of the CoriMission on English of the College Entrance^ 
E>:amination Board, and various other sources, including materials 
received as an institutional representative of ISCPET, and textbooks 
and reference books that might possibly be used for the course. 

C. Control of Experimental Variables 

The factors which may conceivably affect the results of experimenta-1 
research are ordinarily too numerous and complex to permit the 
identification of all of them and no presumption was made that absolute 
precision would be obtained. Neverthele*ss, a serious attempt Trjas 
made to design the experiment in such a way that it would provide 
for an objective and dependable estimate of error. ^ to major 
sources of error of experimentation has to be considered. The first 
was the possibility that the control and the experimental grorps 
might have been unlike each other in their ability to profit by 
instruction in critical thinking so that the observed differences 
in results might have been due entirely to differences in the groups 
themselves rather than in the method of instruction. The selection 
factor suggests that this was not the case since all students enro 1 "'j 
for this course were used as subjects. Anyone allowed to enroll f 
a course in methods of teaching English in high school might be 
expected to have sufficient ability to fulfill the requirements of the 
course. An examination of the descriptive statistics which follow 
reveals that the possibility of this error was negligible. 

The second possible source of error “was that, in spite of precautions 
taken, factors other than those involved in the treatments might be 
permitted to vary from one group to the other during the course of the 
experiment and that these uncontrolled variations alone or in ppt 
accounted for the differences observed. The experiment was designed 
to eliminate such a possibility ly controlling the variables through 
the following measures? 

1. Both groups were exposed to the usual contents of the methods 
course (methods and materials of teaching language, literature, and 
composition to high school English students). 
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2. The same ue::tbooic, Teac h lnn Ei,^h School English by J.jiU Ilooh, 
uas used by both groups. Doth groups were enc -^agecl to use 
ials from the university libraries including the Curriculum Librar” 
and the materials in the instructor *s office which was adjacent to 
the classroom. 
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During both eGm»csters provisions were made to facilitate 
membership in the iTational Council of the Teachers of Engli.sl>»- 
Junior Membership for those t/ho qualified, 

4, Assignments for both groups were similar ciiccpt lyhcn dictated by 
the enperimental procedure, e,n, » the control group \7ao ashed to 
submit a teacher *s notebook which might be of iraaediato help when 
teaching; the experimental group \7as asked to submit exercises ^ 
based on specific skills of critical thinking applied to material 
on a high school level, 

5, Classes were held at the same time of day, on the same, day of 
the v 7 ock, and in the same classroom, although during di^:ferent 
semesters. The number of students in bo?di groups was parallel, 

3a The course was taught by the same teachers. Sister Mary Gonsiaatina, 
SSJ, frora the Education Department:, and Dr. James D. Sarry frem the 
English Department, It seems logical to assume that both members 
taught the control and the experimental groups to the best or their 
abilities. The students* responses on the questionnaires submitted 
at the end of the semester seem to justify that assuxiption, 

7, Visiting lecturers were invited to speak to both groups. Some 
of the visiting lecturers were the same for both groups. The 
inclusion of visiting lecturers decreased the possibility of the 
instructor variable to operate in favor of cither group, 

G, classroom procedured were held constant for both groups, such 
as; lectures, group discussions, use of audio-visual materials, 

9, The sane type of student was eligible for the course; i,e,, all 
those enrolling for the methods course. 

10, The testing of both groups was conducted under parallel conditions, 

11, Doth groups were invited to culTmit an cvaluLi?,ion of the course 
with the use of the same forms and under the eeme conditions, 

12, neither group was aware that an experiment was being conducted. 

The testing was explained in terns of being a part of the cfj,orts 
of the Illinois State-wide Curriculum Study Center in the 
Preparation of Secondary School English Teachers, 
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D, Itamediate Preparation 

The next step was arranging for or assuring the avai.lability of the 
various facilities necessary for conducting the study, namely that; 

1, The university’s audio-visual projectors were available. 

2# The rented controlled reader was demonstrated and made 
available for the use of the students during both semesters. 

3# A teaching machine, the World Book Encyclopedia’s Cyclo 
Teacher Learning Aid, was purchased and made available for the 
students’ use in the Curriculum Library. 



4. Instructional films were available to and used by the 
instructors and some of the students. These films were 
rented from Coronet Film Company, and included the following; 



DO WORDS EVER FOOL YOU? 

HOW TO JUDGE FACTS 

DESCRIBING AN INCIDENT 

HOW TO READ POETRY 

HOW TO READ ESSAYS 

ENGLISH LYRICS 

EFFECTIVE CRITICISM 

VERBS AND WAYS TO USE THEM 

HOW EFFECTIVE IS YOUR READING? 

HOW TO READ NEWSPAPERS 
LISTEN WELL, LEARN WELL 
LET’S PRONOUNCE WELL 
HOW TO READ NOVELS 
HOW TO STUDY 
HOt-J TO LEARN 

IMPROVE YOUR STUDY HABITS 
HOW TO READ A NEWSPAPER 
EDUCATION IN AMERICA: 

THE 17th AI-ID 18th CENTURIES 

THE 19th CENTURY 

TWENTIETH CENTURY DEVELOPPIENTS 



WORD BUILDING IN OUR LANGUAGE 
PREPARING YOUR BOOK REPORT 
READING IMPROVEMENT 
EFFECTIVE SPEEDS 
^JRITING A GOOD PARAGRAPH 
WE DISCOVER THE DICTIONARY 
THE ENGLISH LANGUAGE; HOW IT CHANGES 
THE MATURE READER 
CRITICAL EVALUATION 
INTERPElETING MEANING 
UlTDERSTANDING STYLE 
COMPARilTIVE READING 
HOW TO READ PLAYS 
POEMS jARE fun 
STORY ACTING IS FUN 
HOW TO JUDGE AUTHORITIES 
HOW TO READ A BOOK 
TFiE ENGLISH LANGUAGE: STORY OF 
ITS DEVELOPMENT 

NEW DIMENSIONS THROUGH TEACHING 
FILMS 

AUDIO-VISUAL MATERIALS IN TEACHING 



5a Numerous books and other materials were procured. These were 
used in class and students were invited to borrow them. Pockets 
and cards were inserted for ease of circulation. 

6. The holdings of the Curriculum Library were increased to 
include more material on the level of high school instruction 
in English. 

7. A number of instructional filmstrips were procured for class 
or individual teacher’s use; 
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LEARNING and TEACHING: Bel-Mort Filmstrip Series 

VISmL AIDS FOR TEACHER TRAn^ING: The Jam Handy Organization 

WORDS: THEIR ORIGIN, USE, AID SPELLING: Society for Visual 

Education Educational Filmstrips 
CONTEMPORARY EDUCATION: National Education Association 

8, Over thirty instructional charts for use in teaching the 
course were prepared during the summer of 1965* These pertained 
to the philosophy, the psychology, and the methodology of teaching 
English and were used with a double purpose in mind: to facilitate 
instruction and to exemplify the use of visual materials in 
instruction* 

E* The Syllabus of the Experimental Group 

Basically the experimental group V7as exposed to the same content of 
the course entitled Techniques of Teaching in Secondary Schools as 
V7as the control group. The syllabus for the experimental group 
differed in that the topic of cK'itical thinking was incorporated 
into the course. Following is a list of the major ways in which 
this was done: 

1» A presentation of the need for training students in critical 
thinking through such quotations as: 

There are few, if any, of us from the most exalted 
to the most lowly who are not guilty of prejudice, 
unscientific thinking and action*,,, As long as schools 
teach for knowl.ed^e of facts and principles and not 
for methods of thinking, students will not learn to think, (17) 

2. A study of an analysis of the human mind in terms of contents, 
operations, and products as gj.ven by J.P, Guilford (13), with 
special emphasis on the following: 

Cognition: knowing information. 

Memory: retaining information. 

Productive thinking: proceeding from given information Co 
some other information. 

Divergent thinking: resulting in varied, alternative outcomes; 
searching, changing routes, yielding multiple answers; 

creative performance, fluency of thinking, flex- 
ibility, originality. 

Convergent thinking: resulting in unique answers; essentially 
determined by information. 

Evaluation: checking and rechecking information, memories, 
productions; making use of feedback information; 
checking suitability; employing convergent and divergent 
thinking , 

Education: development of the mind (intellect), 
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Cognitive view: the organism is an agent that discovers in- 
formation, remembers information, and uses information 
in productive thinking (convergent, divergent) and in 
evaluating any of its intellectual products (units, 
classes, relations, systems, transformations, implications). 

3. An application of Guilford *s classification of the operations 
of thought to the teacher *s art of questioning: 

a. A presentation of a lecture by Mr* Daniel A. Lindley, 

"Making Changes in Hov? Teachers Teach," an address which 

he delivered at the Conference of Supervisors and Consul. tants. 
National Council of Teachers of English, November 1965. 

b. An invitation to read a number of references, notably: 
Productive Thinking in Education by Mary Jane Aschner; (3) 
Reflective Thinking: The Method of Education by H.G. Hullfish 
and P*G* Smith; (16) Arts of Learning and Conmumication by 
Benedict Ashley; (4) and Education for Effective Thinking 

by William Burton ^ (6) 

e* An examination of sample thought questions based on 
Early American literature, such as: 

Does the separation of church and state in America 
suggest that this country is irreligious? Refute in the 
light of Early American literature* 

Do present troubled conditions in various countries 
suggest that democracy is the best form of government 
for every country? Was it the best form for early America? 
Does the literature of the period give any insight into 
this problem? 

Whether literature is poetic, dialectical, rhetorical, or 
demonstrative, it often reveals the author's philosophy of 
life* Explain this thesis by using the work of one or more 
of the authors studied in this unit* 

Make abstracts of thirteen selections, one for each of the 
thirteen authors listed. Write or type these on separate 
cards in form of an annotated bibliography. 

Study the selections in unit three to determine the end 
result of the thinking of the author* The concluding 
statement must in some way involve the tif ie. Examine the 
end of each selection and determine: 

1. ) The kind of thinking done by the author 

2. ) Whether it in some way involves the author 
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d« Viewing of Eel-Hort filmstrips: 

THE LOGICAL DBiENSIOHS OF TEACHING 

ASKING QUESTIONS 

EXPLAINING 

4« A study of the possibility of using critical thinld.ng as an 
integrating principle to which all the educational activities 
in the English course might be related (9). 

5o Students* reading of William Shanner*s A guide to Logical 
Thinking , an elementary essplanation of the topic (24). 

60 A study of the thought processes of induction and deduction* 

7. Identification of some of the specific skills relevant to the 
province of English instruction: 

a* Ability to make deduction and interpretations* 

b* Recognition of: Inferences and assitniptions 

Stereotypes and cliches 
Bias and emotional factors 
Main point in a selection 
Verifiable and unverifiable material 
Relevant and irrelevant data 
Adequacy and inadequacy of data 
Consistency and inconsistency 

c* Ability to identify: 

Forms of discourse; narrative, descriptive, 
argumentative, expository 
Types of arguments (discourse): demonstrative, 
dialectical, rhetorical, poetic 
Terras: abstract, concrete, descriptive, 
ascriptivc 

Fallacies in thinking 

0<9 A study of some of these skills of thinking in terms of; 

a. Definition, use of language, fallacies in thinking as 
escplained in Max Black's Critical Thinking (5)* 

b« Forms and types of discourse as related to reasoning as found 
in Ashley's Arts of Learning and Communi cation (4)* 

c* The complexity of the thought process in reading as described 
in Mortimer Adler's How to Read a Boo k (1). 

d. "Composing is Thinking* found in J«N* Hook's The Teaching 
of High School English , chapter 8 (15). 
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e. The place of critical thinlcing in outlining, studying, and 
discussing; Guest lecturer; Sister Mary Fidelia 

Sertillanges, The Intellectual Life (23). 

£• The contributions of semantics to critical thinking as 
explained by F,A. Philbrick in Understanding English , ^ 
^troduction to Semantics ( a book now out of print) (19) 

(See A-2, p.^3 

g. Fallacies in thinking and propaganda techniques as violations 
of suspended jtfigment, criticalness and intellectual honesty, 
accuracy and true relationship* 

hfl Techniques of teaching the anatomy of criticism in terms of; 
RATINGS— •opinions, preferences, acceptances, rejections 
REASONS— 'Statements expressing reasons 
RULES— —to support reasons: criteria or standards of 

judgments, generalizations; reasons for the reasons; 
product of agreement among people (2)* 

9# A study of the topic of critical thinking as it frequently 
appeared in articles in current issues of the English Journal* 

10# Application of the higher thought processes in an Advanced 
Placement Program in English: Guest lecturer: Sister Mary Bernard 

Examination of Advanced Placement 
materials, including the final 
examination* 

11. A study of critical thinking as related to advertising: 

Guest lecturer; Mr. John Crawford 
Vance Packard, The Hidden Persuader.s (18) 

12. Examples of high school students* work; 

a. Exercises involving skills applied to the reading of 
articles in magazines and newspapers. 

b. Thought-provoking annotations of literary selections; 
comparison-contrast studies of two literary pieces. 

13. Presentation of, and invitation to use, numerous books related 
to the topic of critical thinking (books easily available from an 
office adjoining the classroom). 

14. Motion picture criticism and its relevance to critical thinking; 

Guest lecturer; Mr. Rob A. Quarles. 

15. The skills of thinking needed for effective use of the dictionary; 

Guest lecturer: Mr. Rob A. Quarles. 



ll 






16. Assignments ccniposing exercises based on literary selections 
ijhich demanded specific skills of critical thinking (after 
examples of such work were studied and demonstrated) • 

17. An application of the theory of this study to the kind of 
mid-term examination demanding the higher thought processes of 
productive thinking, rather than simply a memorization of facts. 
(See A-3, p.26.) 



Ill Results 

This study was designed to test the effect of a course, which 
incorporated the element of critical thinking, upon students® 
abilities to think critically. Rosu3.ts were studied through the use 
of two tests, an analysis of responses of students to a questionnaire 
and a study of position papers written by the students at the end or 

the course. 

A. Test Results. 

Both the control and the experimental groups were tested at the begin- 
ning^ and at the end of the methods course by moans of the revised 
edition of the WATSOW-GLASER CRITICAL THINKING APPEAISAI. Forms 
■O-I and ri-I (27), respectively, and an adaptation of the DRESSBL 
MAIHEVJ TEST (10) PP* 27-28). A perfect score for each test 

was 100. 



In the subsequent statistical analysis of the WATSON-GLASER 
score was transformed to an equivalent Form AM score for comparabili y 
in assessing gains over the semester as suggested in the test manual. 
For samples of given size one can easily calculate the score 
difference between group means which would have had to prevail in 
order for this difference to reach significance at the .05 level. 

X'Jhen this was done for the WATSON-GLASER, the experimental and the 
control groups of 20 and 18 cases respectively, it was found that 
the score difference had to be numerically equal to 6.59* The 
initial difference was found to be only therefore nonsignificant. 

ThivS removed the possibility of the first source of error referred 
to previously regarding the inequality of the two groups. The 
difference in gains of the experimental over the control group, as 
shown in the table, was 3.59. The test value against a null hypothesis 
of zero difference was 1.579> non-signigicant at the .05 level. The 
difference in performances on the pre- and post-tests, as well as the 
c?ifference in gains on the DRESSEL-14AYHEl'J was likewise non- significant. 
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The above Cable presents the descriptive statistics of the study. 

On the pre-test of the WATSOH-GIi/iSEIl (form YII) the experimental 
and control sroups began at the 75th and 55th percentile ranks 
respectively in a norm group of college seniors. The experimental 
group showed a gain upon post- test from the 75th to the 83rd 
percentile, while the control group stayed at the 55th percentile 
with a net gain of zero. Gain for the experimental group of 3,70 
raw score points, or almost standard deviation, was not found to 
be significantly different from zero. The difference in gains 
between experimental and control groups of 3,59 raw score points was 
also nonsignificant. The table also shows means for the DRES3EL- 
I'iAYHSlJ for which percentile norms were not available. All gains for 
the DRESSEL-1IA.YHEI7 were found to be nonsignificant, 

B. Questionnaire Results 

The second means of determining the effect of the variable of 
critical chinking upon the students in both the control and the 
experimental groups at the end of their semester's work were invited 
to complete an anonymous questionnaire for ass&ssing the course, 

(See A-5, p.29») 

The questions in the course evaluation were general in nature to 
encourage expression of opinion. It was possible for students to 
make statements about a given poiirt in more than one places Even 
though tabulating became a problem oecausc of the nature of the 
questions, the amount of inforraation received coropensated for this 
difficulty. 

Submitting the evaluations to the instructor '57as not mandatory. 
Students were informed that these v/ould not be examined until grades 
were submitted. About 60% of the students in both groups cooperated 
by submitting the questionnaires, 

1, Responses of the Control Grouo 

Over fifty favorable comments were made by members of the control 
group indicating that Che course met with, or exceeded, their 
expectations; that they enjoyed the course because it was help- 
ful, interesting, varied, organised, successful; that the instruc- 
tion was enthusiastic but relaxed; that the work covered a vast 
area but that nothing was superfluous. Among the specific 
factors that contributed most were the guest lecturers, 
especially Dr. Barry's lectures on language and Sister Mary 
Bernard's presentation of the work in Advanced Placement in 
English; the variety and amount of materials presented in class 
in the form of duplicated materials distributed to the class, 
audio-visual materials presented while teaching or demonstrating, 
and the variety of reading materials made available for the use 
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of the students* Many favorable comments were made about the 
group discussions* Inexperienced teachers in particular found 
these profitable as they felt free in a small group situation to 
discuss topics of concern to them* 

Ccxnments of a negative nature included the following: five 
instances expressing a desire for more class discussion; seven 
instances stating the need of more procedures of a practical 
nature; three complaints about insufficient use of the textbook; 
two requests for help in teaching drama; and two expressions 
about the desirability of extending this methods course to two 
semesters of work because of the extensive content* 

2* Responses of the Experimental Group 

The comments of the experimental group were similar to those of the 
control group* All but two students stated that the course met 
with or exceeded their expectations* The explanation of the 
negative responses was that they did not know what to expect from 
the course* Specific comments regarding the course were: the 
course was enjoyable, profitable, varied, and flexible in format; 
it formed a foundation for student teaching; students were allowed 
to form their own coaaluyiions* “Many favorable comments were 
made about the visiting lecturers. A number of students thought 
that the lectures on linguistics should bo a part of another course 
thus leaving more time for lesson planning and techniques of 
teaching* A few students thought that the group discussions 
could have been more profitable had they been more structured* 

As in the control group two students thought that the course should 
be extended over two semesters* Almost 50% of the students made 
favorable reference to the factor of teaching for critical thinking r 
This is significant since they were not asked specifically about 
that topic* One student expressed it in terms of wishing that 
more courses would introduce teaching in terms of critical thinking* 

3* Summary of Students^ Evaluations 

The students of both the control and the experimental groups were 
grateful for the establishment of a separate section for English 
majors taking a methods course. They were overwhelmingly in favor 
of using varied instructional approaches, such as the use of audio- 
visual materials, demonstrations, guest lecturers, group discussions, 
as v;ell as the use of the English Journa3. and relevant duplicated 
materials* They appreciated an exposure to various topics and to 
points of view from varied sources including lectures by qualified 
persons having theoretical or practical knowledge of the subject* 

The experimental group expressed appreciation for being exposed to 
the study of critical thinking and made comments about the desira- 
bility of teachers becoming familiar with the area of critical 
thinking and its applicability to high school instruction* 
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C. Position Papers 



A third measure was taken to help evaluate the effect of the 
experimental factor upon the students. Both the control and the 
experimental groups were given one hour at the beginning and at the 
end of the course to write a position paper identifying vzhat a good 
high school English teacher is and does. Lest the taking of the 
critical thinlcing tests unduly influence the writing of the position 
papers, these were written before the administration of the tests. 
One of the main purposes of the position papers was to determine 
the students* degrees of awareness of teaching for critical thinking 
as a worthy objective of education. An aaalysis of these position 
papers revealed that the control group mentioned the topic fifteen 
times in the initial papers and seventeen times in the final ones. 
The experimental group mentioned the topic ten times in the initial 
papers and thirty-eight times in the final ones. From this evidence 
the conclusion may be drawn that a conscious effort to alert 
teachers to the importance of teaching for developing students* 
abilities to thi.nk critically can result at least in teachers* 
awarenesses of this responsibility, 

IV, DISCUSSION 

The abstract nature and the complexity of the operations of the 
human mind make measurement of those operations difficult. This, 
no doubt, explains the paucity of standardized tests that purport 
to measure thinking. After much search, the investigator decided 
upon the WATS0N-6IASER CRITICAL THBIKING APPRAISAL and the DRESSEL- 
14AYKEN TEST, which, among published tests, seemed the most valid, 
although not entirely satisfactory for the purposes of this study. 
Another factor which needs to be considered in evaluating the 
test results is the limitation of time within a methods course 
that could be devoted to the study of critical thinking. The 
usital coucent of the course was not sacrificed; hence it was 
difficult to find sufficient time to adequately study the various 
phases of this experimental variable. 

In the study which the investigator conducted with 1,000 high 
school seniors, positive but statistically nons if, nlf leant results 
were likewise obtained in the WATSON-GLASER CRITICAL THINIC1N6 
APPRAISAL, which is a power test consisting of five subtests; 
inference, recognition of assumptions, deduction, interpretation, 
and evaluation of arguments^ When one considers the 180 days 
(approximately 700 hours) of high school instruction compared 
to the 45 hours of college instruction for a given course, one is 
not surprised to find only modest gains in the present study. 
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These statistically non-significant gains by both the high school 
and college students suggest that the WATSOH-GLASER is a difficult 
test and, perhaps, not as relevant to an English program as the 
DRESSEL-l-iAYHEW, which tests such skills as: finding the main point 
in a selection, information supporting the author's position, 
ideas and beliefs which the author takes for granted; identifying 
stereotypes, biased statements, and unverifiable data; classifying 
kinds of terms and the form of the discourse. The high school 
students* gain in the DRESSEL-IIAYHEW was highly significant. 

This can, perhaps, be explained by the fact that the high school 
students were systematically exposed for the first time to these 
skills during a whole year. The college students, on the other 
hand, already possessed these skills to an appreciable degree and 
hence did not make marked improvement. 

The positive gain of the experimental over the control group, 
even though statistically nonsignificant, seems to have meaning 
especially when considered in the context of the responses on the 
questionnaires and the position papers. The oral and written 
comments of the students concerning the importance, the necessity, 
and the desirability of teaching for critical thinking suggest that 
this is a highly vrorthy objective in teacher training. 

V, CONCLUSIONS, XIIPLICATIONS , AND RECOMffiNDATIONS 

The development of a sound comprehensive theory and, through it, 
the improvement of educational practice are the primary aims of 
research in education. Both of these aims are important in a 
teacher- training program and both have motivated the present 
investigation as an attempt to help teachers to understand better 
the possibility of the varied operations of the human intellect 
to be exercised within the context of the usual high school English 
program, 

A basic assumption of this study was that the teacher’s performance 
in the classroom depends upon his understanding of the operation 
of the human intellect and that, although no subject in itself 
can be depended upon to improve the thinking of students, almost 
any subject can and should aid students to acquire that important 
ability whose operation is essential to personal and societal 
security. It is regarded by educators as one of the major goals 
of instruction on all levels. As the foregoing study has shown, 
it is especially applicable in an English class on the secondary lev^l. 

The present experimental research study tested the hypothesis that 
a conscious effort to alert and train prospective English teachers 
in some specific skills of critical thinking and in the possibility 
of using these skills in a high school English program can have a 
positive effect on the teacher’s abilities to think critically. 
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The positive but statistically nonsignificant results of the testin^, 
pirogram bear practical implications. If more valid tests mignt be 
found and used, significant results might appear. Ir more time 
were devoted to the topic of critical thinking, as was the case 
in A previous experiment conducted by this investigator witn^high 
school seniors, better results might be obtained. liecause^cf the 
extensive content of the methods course, the limitations 0 £ time 
were too great to study critical thinking and its application to 
the classroom in depth. The fact that the scores for both test, 
could be greatly improved suggests that training in these skills is 
needed. This was corroberated by the teachers responses in a 
questionnaire and a position paper written at the end of the course. 
Their statements revealed that the teachers exposed to such a 
program became aware and were appreciative of the value ana need 
of teaching that promotes varied skills of thinking. 



The immediate implication of this study is that emphasis on teaching, 
for thinking can be given in other courses preparing high school 
English teachers since the limitations of time do not allow 
complete coverage of all material in one methods course, ihe theory 
of it is usually presented in a course in educational psychology, 
but this seems to be inadequate since most teachers need help in 
bridaing theory with practice. Vlith a predominant use o£ tne lecture 
method in college, this bridge ia usually not supplied by means 
of th'=*.ir own educational experiences. 



One possibility ia offering a separate course in the education 
department devoted to teaching for thinking within the conte::t of the 
usual curriculum on the elementary or high school level. 



The most urgent implication is that teachers need to be alerted 
and trained to teach for critical thinking. America needs teacher.. 

V7ho are convinced that it is neither wise nor possible to give 
students all the answers they will need in life and who prepare 
their students for constant readaptation to new and different 
problems in this kaleidoscopic world. America needs teachers who 
know that the aims for thinking are not complicated and that class- 
room possibilities arc vastj who, through specific, direct instruction 
and ample opportunity for practice and drill, sequentially developed, 
provide continuity in Improving the intellects of their students. 
Lerica needs teachers who place so high a premium upon the 
ability to think critically that their students feel responsibility 
for thoughtful behavior, experience a keen satisfaction of sclr- 
realization upon achieving skills in critical thinking, ana arc 
able to reconcile the process and the result of critical thiruing 
with their moral convictions. 
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Ruskin*s statement, ’‘The highest rery^ard for man*s toil is not 
what he gets for it, but what he becomes by it," can be applied 
to such teachers for whom the highest reward for their efforts 
to teach for critical thinking is not what they or their 
students get from it, but what they and their students become by it, 

VI. SUMMARY 

The Education Department of Loyola University conducted a study 
v/hich tested the hypothesis that it is possible to train prospective 
teachers in some of the varied, specific, separable, and measurable 
skills needed for critical thinking* This was done with the hope 
that, having been alerted to such skills, these teachers might 
function more efficiently in a democracy which demands of its 
citiisens abilities of clciar thinking, of attacking problems 
intelligently, and of exercising critical judgments. 

Both the control group of the first semester and the experimental 
group of the second semester were exposed to the usual content of 
the methods course with the exception of the critical thinking 
variable of the experimental group* This variable included: 
a study of the operations of the human mind as defined by J.P* 
Guilford; the need for the "cognitive" rather than the "stimulus- 
response bias" in teaching; and soma methods and techniques that 
might be used within the context of a high school English program 
to develop skills of critical thinking. Some of these skills are: 
the ability to make deductions, to make interpretations, to 
evaluate arguments; the power to recognize inferences, assumption, 
stereotypes, bias, and emotional factors; the capability to point 
out the main point in a selection; the ability to discriminate 
betw€‘en verifiable and unverifiable material, relevant and 
irrelLevant data, adequacy and inadequacy of data, consistency 
and inconsistency of arguments; the power to identify literature 
in regard to form (narrative, descriptive, argumentative, 
expository) and in regard to t3;pe (demonstrative, dialectical, 
rhetorical, poetic); the capacity to identify abstract and 
concrete, descriptive and ascriptive terms; and facility in 
recognizing propaganda techniques and common fallacies of thinking* 

The effect of such a program was tested by means of the WATSON- 
GLASER CR.ITICAL THINKING! APPRAISAL and an adaptation of the 
DRESSEL-MAYHEW TEST* The difference in performance of the 
experimental over the control group was positive but statistically 
nonsignificant* If more time might have been devoted to the 
critical thinking variable, the results might have been more 
significant* 
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Two other measures j a position paper and a questionnaire* revealed 
that the teachers exposed to such a program became more av/are 
and more appreciative of the value and need of such teaching 
than they had been heretofore and to a greater extent than the 
teachers who were in the control group* They realized that* 
since the ability to think critically is an important and pervasive 
educational objective in a free society, teachers need to be 
alerted to the skills of critical thinking and taught to use 
various methods and varied materials possible in an ordinary 
classroom in order to make the immanent activity of critical 
thinking function, not merely in some special lessons but during 
many parts of the day. They agreed that the English classroom 
provides a wide range of materials and procedures which can be 
used to promote the improvement of Intellectual abilities of 
students* With the help of Guilford’s model of the structure of 
the Intellect they understood why modern experimental psychologists 
suggest that transfer effects are possible by calling attention 
to similarities and emphasizing generalizations and that these 
transfer effects are more readily made possible by developing 
the skills involved in intellectual operations of productive thinking 
rather than by simply augmenting intellectual products by "coverage" 
of facts# Such teaching, they realized, places stringent 
demands upon the teacher; it calls for creative teaching; it 
calls for an atmosphere conducive to productive thinking; it 
calls for the teacher’s willingness to continuously think 
about and thus promote his own critical thinking* 
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Sources of Audio-Visual Materials 






1 

4 



!• Bel-Mort Filins, 619 100 Building, 520 South ¥. 6th Avenue, 
Portland, Oregon 97204, 

2, Coronet Instructional Films, 65 East South Water Street, Chicago 
Illinois, 60601 

3* The Jam Han(^ Organization, 2821 East Grand Boulevard, Detroit, 
Michigan, 48211 

4, National Education Association, 1201 Sixteenth Street, N.W., 
Washington, D,C. 20036 

5* Society for Visual Education, Inc. 1345 Divers ey Parki-jay, Chicago, 
Illinois, 6o6l4. 
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EXAMINATION QUESTION 
(one hour) 



The variety of topics discussed in the articles of the January 
issue of the English Journal suggests the complexity of subject 
matter within the English curriculum# How can English teachers 
reconcile this complexity with the additional burden placed upon 

them as expressed in the following; 

#• f democracy at its best demands of its citizens ability to 
think clearly, to attack problems intelligently, and to 
exercise critical judgments #»*at every level of instruction 
they should have opportunity to set forth their ideas concerning 
topics of interast to them, to substantiate theii stauements 
with evidence, to draw inferences carefully, and to order 
their ideas clearly for presentation to others# At the same 
time they should have practice in those skills which rreedora 
of speech and of press demand of the listener and the reader# 

They should evaluate critically ideas found in newspapers, books, 
and magazines, heard in discussion or over the rad:lo, or presented 
on the screen, learning in the process to validate authority, 
to distinguish fact from opinion, to recognise untoward 
emotional appeal, and to detect false inferences or unsubstantiat- 
ed generalizations. 

Commission on the English Curriculum of the National 

Council of Teachers of English, The EnglJiSji Language p*45 

In a well written essay, explain (and/or illustrate) this relevance# 
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The DRESSEL-MAYI-M7 CRITICAL THimiNG TEST 
(adapted and reprcdueed with the permission of Dr. Paul Dressel) 



You will be given an opportunity to read and study a passage of 
writing and to give your interpretation of it. Read it through to 
see what is expected of you before beginning. 

In the various questions which follow, you will be asked to 
examine the selection from several points of view. You may answer 
the questions in any order. There will probably be more things to 
note under some questions than under others, but you should make 
your coverage as complete as possible. 

Selection 



Those of us who have neyer been abroad do not realize hov7 much 
we Americans owe to our competitive enterprise system. A year or so 
before the Second World War broke out an economist was sent to Euroy.:^ 
to find out how much the earnings of the average American factory 
worker would buy in comparison with the earnings of workers abroad. 
Certain articles were selected that are used by practically all 
civilized peoples. In each country the economist visited, he showed 
the goods of comparable quality available, as was frequently the case 
he bought the nearest equivalent. He ascertained from the best 
available official official sources the average wages paid factory 
workers. Por his food comparison he used as his measuring stick a 
basket containing a selection of twenty-four different foods in 
ordinary use. The average American family of two adults and three 
children uses four of these baskets, or the equivalent, every day. 

To earn these four baskets of food, the investigator found that the 
average American Worker had to work about 1.6 hours; The British or 
French worker, 3.2 hours; the Belgian, 3.6 hours; the German 3.9 
hours; the Italian, 6.2 hours; and the Russian, 10 hours. 

While the United States had one automobile in use for every 
four persons, the proportion was one to eight persons in France; 
one to 29 in Sweden; one to 252 in Russia; and one to 1344 in Bulgaria, 

Under our competitive enterprise system in America, a thrifty 
worker does not have to spend every cent he earns to support his 
standard of living. This is evidenced by the amount of life insurance 
in force. In the United States life insurance averaged $042 for 
every man, woman, and child in the country at the time this survey 
was made. In England the average was $353; in Germany, $117 and in 
Italy, $36. Along V 7 ith our industrial progress has come a remarknb?^ 
expansion in general social welfare. Our hospitals, museums, libr:: 
and schools are the envy of the civilized world. 
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A-4 

(continued) 



There is no need for me to bombard you V7ith further statistics, 
With all its shortcomings— and there are many because it is operated 
by fallible human beings— competitive enterprise in America has 
undoubtedly brought more blessings to the average man than any 
economic system the human race has yet devised. The men of our 
farflung military forces are discovering that with their own eyes. 
Just a fev 7 weeks ago a young soldier friend of mine in France, who 
had probably never been miore than a hundred miles from his birthplace 
in Lancaster, Pennsylvania, v/rote me that after seeing the way 
people lived in Europe, he thanked God that he had a country like 
America to come home to. As a matter of fact, he never will come 
home because he lies tonight in some lonely grave on the German 
front where he was killed in action in Hovember..,) • 

1. List any stereotypes or cliches which you can find in the select 

2. List any examples you can find of emotional or biased statements 
in the selection. 

3. Does the selection present unverifiable data as though they v/ere 
facts? If so, list them. 

4o I'lhat is the main point in this selection? 

5. Are the facts which are presented in the selection as supporting 
the author *8 position pertinent to his argument? Explain. 

6. What additional information is needed before passing judgment 
upon the author's position? Or, do you think enough data have 
been provided? 

7. Is the presentation consistent? If not, list examples in 
inc ons is tenc ics . 

Judging the selection as a whole, what are some of the ideas 
and beliefs which the author takes for granted? 

9. VJhat form of discourse is this selection (narration, description, 
argumentation, exposition)? Give reasons for your answer. 

10. What kind of terms (concrete or abstract) are used in this 
selection? 
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A-5 

G0URS3 EVALUATION 



Course Number 



Date 



Your candid evaluation of this course may help in tuildins^ a 
better curriculum for future classes* You neea not sign i-nis 
paper if you do not care to* 



1, Did this course meet with your estpec tat ions? 



Did it exceed them'^ I w / 




2. Identify special areas, features, techniques, etc. that were valuable. 





3. Identify special areas, features, techniques, etc. that were less 
valuable, superflnous, nep-lected. . . 





4. Have you any augsestions for improving the course? 





5, Please feel free to make further criticism, either positive or 
nega t ive . 



• O 



